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(54) FRAME LINE RECOGNITION DEVICE character area of the structure. 



(57) Abstract: COPYRIGHT: (C)1996,JPO 

PURPOSE: To obtain a frame line recognition device of 
high reliability even when the frame line is thin or 
when a form is inclined concerning preprocessing device 
recognizing the frame line in the form so as to segment 
an area where a character exists in the automatic 
recognition of the character entered in a picture 
including the frame line and characters such as a form. 

CONSTITUTION: A corner detection means 102 extracts 
the corner feature point of the form frame line from a 
form picture binarized by an image scanner 101 binarizes 
and a constitution element extraction means 103 extracts 
the constitution element of the closing line (of letters 
T, +, L, etc.) from an attending corner and its 
peripheral corner feature points, a minimum rectangle 
recognition means 104 recognizes a minimum rectangle 
from the connection of the constitution element to 
output rectangle information, and a structure 
recognition means 105 generates the tree structure of a 
rectangle to connect and recognizes the structure of the 
frame line based on this tree structure to inform a 
character segmentation means 106 segmenting a 
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7bv^^flii!c&^ y m-f y ffi l#«&£«n-*# 

[0 0 0 1] 
[0 0 0 2] 

minimi} &£. j&mMx&Huzft^ ocr 

(Optical Character Reader) £~? &jCjzfl$$& 

[ooos] mmo&msmt lt, #isco^>^T'i^ 

-2 1 7 58 3 *CD|QS«S:*2 2H& 
SlCl^-rS. W^Ai7Sl5 10 0 1 t*^S£*f^SpjgS$:-g- 
tfH«S:^Eb2fflfl|^lif«^^y 1 0 0 2fOfft(frr 
So «#ftl5i'Slffla$ 1 0 0 3 ttHMW^E U 1 0 0 2 {C 

ft&ffigp 1004 x*m^tmu3\tmfttm&znz> 0 m 

a^nmstu ^ipj^amgp 1 o o ex-wcutm^ 
mmztiz>o xzwmim 1007 itm^\^m^mm 

B 1 0 0 4 T'ttffiStlfeft^«^hM*l«^^ttffiap 
1 0 0 6T'ttffi$^fc^|p]^$:ffl^T35:^MJI|!cfeJ: 

[0004] wyffisjftfcjsswtcotvot. 
<mmr , «^w^ifs^^ik voi.jto-d-h, n 

0.8 pp. 1268-1274 1990) #&y, Igf»t>|gfflW&i: 
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[0 0 0 5] 

^itSM^MSv >TW^t LTSAWrtR (btifc^te, 5 > 

< surra *i«ttm-r s £ v * 

[0 0 0 6] *jHBBf&l*. i(ISBfi^^SNB«:«Kt- 

Jlfe*§£-fC*f LT iE«THaHf£<Z>ast ^^HigSSrli 
[0007] 

(Dzmmm cs?& &mz n o" , tomv i" ) 

JftS!&&%& L^cjis * •©» y jl Uft/.Mgf&&SS3K L 
[00 0 8] 
[0 0 0 9] 

[0 0 10] Hi ^MO-llffiM^^dMBitt 

ISScd^d ^ ^«^0T**>.&„ l o l ttffiM&K&qiy 
2fflH«S:ffl^rt*-f^-s;x^r"V*— , 10 2tt#ig 

LTffiA-rsa— ^— ftffi^a. 10 3 ttjiin- 



/bm&zwm?zm'bm&wffi.^m. 1 o 5i*#«/jN*g 
©,io6 itifMkofKi^ e>:£3«c£<?j y ffi-r^?^ 
[ooii] ^©i^»c«wanfc#iiBEsa»fi«tco 

tCty, GggC£^#i&y 2fflHlgH;Mlu *<D2im 
«tt^e>n-+-«WM 1 0 2 tc J: y , ffiftafttflkaift 
|q5C^n-KS:#^UT^IEM$:3-^-J[m^ 10 
fcl/Cffl*U 4tffiBSI*fftffi3^Kl OSfCfcy, &gn 

4»cj:»j, m^ffl&zm&Lxmjiu &m'bffl&fr*> 

dtLT««lkZ>«B6S:l8»U *®m!W!>«Bi*»6^« 
yffiU3M8l0 6lCj:y, S^IHBt&qjyffiUT, 

[0012] ^K:«ffiR)09K(Z)MW&»M(C8^T«. 

*^&«w^y24iHffcsmA+<5>f^-2;^*-v-#-- 20 
10 1H tMBft&itt4 0 0dpi sit u mmx& 

zmmiz led (SBt^f-f^-K) ^T«L-eo)H*r 

3fc8:Hfc5&Z>C C * ^TffoWR y , tt*<Z>HMto? 2 

VHil^iCDjKS (5 5 0~5 7 0nmftfi© ©LED?: 

^WMWMffiB : " gBffl!]lE£ LTorMitt 30 

>yi5-l, Nov. 1977) «<Bl<ftie>tlTV^2«fWlffll 
SfeTf&y, M^C-gr*3-B:TffiS(D2^t^^$:M^-r 

[0013] #ac, 3-t-«flj*ai 0 ziz^^xm 

[0 0 1 4] ®2&C;f3Vvt> 2 0 1 1 0 1 

jt)^02fltiif^l 1 OfZ8^0)^fSl=I-K$:^-rS 40 
#|pjn- K###gt 2 0 2 tt^inin- K©3Effc-*-S# 

S^ti, 7iJ-V>©fi-f>3-K(H. Free 
man:" Onthe encoding of ar 
bitrary geometricconf igur 50 
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ations"; IRE Trans. Electro 
n. Comput. EC-10, 1961, pp260 
-2 6 8) tfJ^ftl^tlT^S, 
[0 0 15] S-T, ^f6]=l-K#-^IS2 0 ltcovx 

t. 123 fe/snrswr*-*. m3 ( a ) ^fan-K 

#53^2 0 1 ©ED»flte8BIT»S. 03 (a) (CfeVN 
T, 2 1 ltt^-O^y, 2 1 2&3X3©jfe3lEf& 
2 1 3{£^ffi&2 1 2©tfy NA*->{Cj;oT4 t^y 
' h©^f6jn- HTB^2 1 4 $rm±t-SLUT 0l/y* • 

#l«Jn-F«\ III 3 (b) 

kj5*"**uc, asiif^2 o 3 frbmsxDffigmmizfafr 

e>83frft£, #[hJ3- KfcLT**lW 1" ~" 8" 
<^T*«H-fc©T'&5„ #1*03- Ktf#fMi9[2 0 1 
2480* 1 0 llC*fL3x33feae&2 1 2T*^U j£ 
£ffiftfre>©tf y hA'ii->T'LUT 2 13 £$^4 
fc^y S©#ftn- K&tftfr*-*. *fc33T*ti, *iftn 
-Fli> " l"fr6" 8" tlsfctf, " 0" #e>" 7" 

[00 16] LUT2 13WU ^ItH-fCjCoT^-* 

tc*fur*ff (»2) fe»fc-r*fti3-Ki&Km-rs 

%©T*, *H!6MT-«*[liy^|6lfC^[«I3-K$:^-t 

fc£U G&3) 
WmmiffiKteW-yizMLTltm" a" £tf-£U 
A^fRWrtSPJCttir f " . mmtzttW o" fe^ti 

•ftifuy^Ts*©^^ 

[0017] 

mi] 

dO' (d]-d3-db.dn - I *»o 
8 

Z! d i > 1 
i=l 

No (8) =1 *>o 
No (4) =| 

[0 0 18] 
[&2] 

d i • d i 
fcfc'U dfi-d 1 

[0 0 19] 
GSS3] 



5 

dO- ( d 1 - d3 • <J5- d7 ) = 1 *'0 

8 

£ d i = 1 i>o 

; = i 

Nc(8>/1 #0 
Nc(4)i<l 

fcfc'U 

No (8) =2 < d i - d i • cTTTI • d I +2 ) 
i€Sl 

No (4) =2] < d i -d i • d i +] • d i +2 ) 10 
iES] 

Sl=(l,3. 5.7), d7+2 =d J 

[0 0 2 0] ZLZ.X\ 7&g5&fH(DWmd l~d 81*, EI 
3 (a) ©j£*tCt8»%©fc-tS. fcfc. Nc(8)tt8 

mtm. Nc(4)ii4^gc^i^«tu 

fCJ:oT»&n**l^3-Klf«fc®«S:Bl4»Cn^r > EI 

4tcfev\x. Mi2 1 5«" o" xflwyaT&n. sp? 

ffiftt2 1 8©XvS?»CStLT*ia»JtC*fil3- K2 1 6 20 

[0 0 2 1] &tC, #^m#IS2 0 2Kr3WtEl5& 

*>S 0 H5Cfilr»T, 2 2 0»45>f>^ i Ey, 2 2 1 tt 
#<i<D3 X3j£ffi& 2 2 2i£££g2 2 l#t£>g>D0 
4992 3 ltCfjgoT. Dl~D8 09fi#2 3 0 0>ffi^7«: 
388l-r*MPX , 223l£MPX2 

2 2#>&<Z>tftf72 2 8d3 e fcJ>*D0fg-^2 3 1 S:#flgU 
l^ffl«&^tfe«)ffln-t-!|m* Srm^-tS L U 30 

&S, JgtTtc. W8Bl!iaj^®2 0 2flQ»f^»co^T»W! 

t§. 

[0 0 2 2] *-T, ^ffiin- Ftf#3Mg2 0 l fr£©# 
(pjn- KBCH2 14£, jfeSB&2 2 1 ICA#L— 

[0 0 2 3] 4$«J|i|ffi#«l2 0 2tt. j£fi|R2 2 1**6 
©D1~D8 <7)^l6ln- 2 3 0 Sr-tft-tfitM P X 40 
2 2 2 {CA7J U ^SISKi&SD 0 tf)#|nj=r - K 2 3 1 
#^?OZZ<Z>B£fcffiKD 1 ~D 8«$ftS„ &SH 

oro^rfijn- K2 3 1 nmtRsnt-ffiimmoxfa 

3-F2 2 8jft»&, LUT2 2 3»C«fcyflfai3-KCf 
i:K«fg-^2 2 7*»&XYJS«Wffi»2 2 5T?58£Lfc 

So «»3-Kf!K»2 2 4TH Miaif^T? 

[6J3- F2 2 8©flCtfWHe3- KT'&S" a" 

ntn5*>sflsu W3eatifcie»iLUT 2 2 3 ic 
a»uraa3- Kef tLxw a" 50 
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+«. 4f«3-Kcf»*. GK4) TaaatLfctesi 

&LUT 2 2 3 {CgSfLT£< &0>T*&So 
[0 0 24] 
DR4] 

Cf = DO* 1 6 + D i 
[0 0 2 5] fc£U Dill 

lft(ciW8LT^*iiSR®3&ffiF3-K"e*S. EI6(c#^ 
3- KOftteaVT. 06 (a) li#^3- NW" 3 

i" am. mm (b) »**j«3-Kffi*^ 1 7- ©«. 

HH (c) t*ff»3-K«W«" 7 5" <D0L mm (d) 

ii#^3-KW 53" wm, una (e) tt$#«3- 

Kffltf" 5 6" ©09. BIH (f) J*W«3- Kft*<" 6 
It. *H»J*l$Itc*lfll3-KS:#^Ufe3^ *®ytc# 

[0026] *»c, mfmmmn&m. i o 3, 
§sffM io4. i o 5 ts&ttt&w y ffi 

ii&EI»«l«SBl7»c^LJgilTfcSWBi-s. EJ7fc;J3^ 
T, 1 1 ltt3~*—fcffi#«l 0 2fr£<Z>3— +-- # 
M5:A*t§FIFO (7r-^h • -f> • 
h - 7"? M 1 1 2fc«fct>*l 1 3 tig- V 7 htf 

x7«LS5:^e)fc«)<DCPUi:9-^^ : tU, 10 7(i 
1 0 lfre>fl>5 I --*«:»|l(W - S>f*--5?* i e 
•J, 1 14ttFI FOl 1 12fetf>f*-s;*^y 1 07 
fflf-!i' : &CPUl 1 2fcr7-***Ey 1 1 3{C«|S I 
/FEi&T'&So 1 1 5fcj:rjl 1 6 te^EMP L < ii 

&jSSI/FEI»*J:tfj^Wafi«€:aKi-. 3 

-t-ia^sio 2t«iifjanfc3-7- #mst*F 
1 Fo*^y 1 1 i{cA*sn. js&cpui 1 2 km 

.a?-**^; 1 1 SJCBBltStlS. 

^V>W y ffi Lfeg*' ! 5t^ Lfe^T'^«^ y ffiS 
til /F 1 1 5 fe^UT4®»*»ilBS:«HSLfeA^SB« 

[0 0 2 7] ?^{C, flWaSWiliffi^Siosjcov^TK 

w-r So mfmmm&^mi 0 s^^tD^n^ns 

fC^L^fSo EI8{CJ3V\T, 2 4 5~2 4 6(i3- 
t-ia5#ll 0 2A^3-t-5m^FI FO*=E 

y 1 1 1 fe^LT»&*ifc3--^H$aib&. 2 4 4 1*3 

— W«jaMOaSR«W. 2 4 1-24 3 tt»&nfc# 

^^^1-0 *-f«4jRtc#e>4xfe3— m*2 

4 5 Lfcli^ 3-t-M*2 4 5& 

^fi4Cfl8m»W2 4 4 rt»C««-tS3-^--««bS*<& 

(a) ~ (d) fC5%-t4«B. T^©«fi5Simttig9 
(e) ~ (h) +^®«WaSRttlW®JliB 
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iattttt3M3 i o 3 (Dawit&mgMzwi o (c#fig 

(1) a-^Hta&fc?-**^'; 1 1 3*»e>A*t- 

(2) *m®3-t- 4#oj&#9 o° on— 4m* 

frW^Sfiy^U 9 0° 3-t-M^f>f0 
** (4) ©Xf'^A, •?ftgitft&& (3) ©X^y 

(3) t£a©3-^Hm£©±M£&6£LT. ft 
«©&fc£flF^$6HS rftT', HI l (a) IZTjk? 

mmmmzmELx. ssca- 4$t%&#Hi i 
(b) tc^«fe^3-^-«awi^*jritt 

LTjgSiitLT 9 0° 3— J-HWfe&fc"*-*. 

(4) mt9 0* 3— <f$ttt&£Hl 1 (b) IC 

«ffla©«M6W»T , mtf (6) tcii*. -e-iTfamft^ 

tt (1) fCJttf. 

(6) C7-^^^E >J©cfi(D9 0" 3-t-MS?:*ft 

*MKj&®#fl83- KC r fcAA-r*. 

(7) (3gC 5) ©*&»fc-r#fla3-KCpS:«ro«# 

jftttLJ?«R!aSRfc:ir^/-tr>yan6%»©4:LT (l 

0) Kit*. #fi£Lfctt*ltf (8) tCittf. 33T\ M 
h LT, *Hfcj&2 5 5 ©#Jt3- KC r = 2 ©#&©#§ 

mmmzsezMi 2 (a) ic^vr. 

[0 0 2 8] 
DR5] 

I Cp-Cr I =4 

[0 0 2 9] 

me] $ ■ 

(xp-xr) 2 + (yp-yr) 2 £ Gr 2 iO K 
C r = 1 CDHJ : x p >x r . y p < y r 
Cr-2«»}: xp<xr, %>-z> yp<yr 
Cr-3©6$: xp<xr, ;0>O yp >yr 
Cr-4«M|: xp>xr, *>-3 y p >y r 

[0 0 3 0] f-tdU ^)V-hfy{f^mmm : Gr, M 
MulUSm : x r, y r , 4^KI : x p, y p. 

(8) Ell 2 (b) ©«feo{c, %Hfc&2 5 7 5:^:1 
Tjfc^SfcM^SCfrfiJfctftffcG rX2 w©5£7Eg8SR 
i«258 ©*K#i£"f Sffi^©#RI=i - Ktf. OR 
7) *fc GK8) ©*ftS»fc"r*»if-5*«^*. 

[0 0 3 1] 

m.7] 

Cp -Cr = l 

[0 0 3 2] fe£U *^£©#flg3- KC r =4 ©i: 
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£tt. W©#^3-KCp=lfc1-S 0 
[0 0 3 3] 

ma) 

Cp-Cr=- l 

[0 0 3 4] fc£U m*©#i3-FCr = lffli: 

^©#flg3-KCp = 4h1-So 
(9) 0K7) frSfcti 0R8) ©4f%e>^&»fct« 
^tctt. T^^SSSRfcWWiU G&7) i: 

10 L/T (10) izmts. fati<D&i!t*jffit=.2te^m&\t 

(11) fCittfc. 

do) l*. T^t$£tf-t?mfmm£ lts»s*i 

fc#Ha3-K&$Oi/-bT:/* , LHl 2 (c) {c^-rs^ 

fefc'U 012 (c) iCfeWS, E£fa N# 

fa w^fifinatfs^fiftt-en^tiHi 2 (d) {c^ti-^ 

(11) (9) ©^T^n©^lC%Tifc&^#J|g3 
20 -KttJ8*"T6. 

(12) 3 — fflhltffex ff& tit^WrS 

lisemtcWTu -t -j-pftms^tt (6) tast?. 

RhOJffiffiSrtf "5 £ {C <fc »J . EI 1 3 tC^-T##g© U 

t. +^(D&m8mmtmfczn&. teu 013 

[0 0 3 5] &K&l>SmSm&Bll 0 4 {COVNTIJi^ 

^LTS/jN^Sr^c-r-S-rst;©^ #tii©ffifc&£0 
30 14£flJ»rvrSSBJ-r4&. 014 (a) J*. g/jN*©OT§fe 
^104 ©#L3©m&S:^-f =&©T\ =S^H^IrI± 
©#&aGl§S-ttU>^«2 6 4 0JH«Tf5Vr) &&>(fltt 
JC»*J, ®/h*©£©$&,&2 6 5 £*©£©£_t£: UT^EI 
y t U >*ifcg2 6 4 £fc£*oT5S©&*jCM*Uift/J^ 
7£2 6 7 fcWKUfc ft/MSgm?® 1 0 

4©#yi$N EH 5fe«fcOSESl 6tC^Lfc«fll7n-tC 

S6oTi¥iffl{cHJi^-t-So mA^m^m^m. 104 ©^aai 
40 hi 5c*wtejaaiss:aBi^<5«ia7 

(1) All^yR^-^SrU-^ji^yjcS^iito. 

(2) fl»as^iK s -#©**^^a*iTt^t^*fa^ 

(3) S«d^K:*3easBUTV»«:v>" #" 
*©¥©#tfr v>*3Efl«sasWBHi: LT, Hi 4 

(b) {c^-r«fce>^ii!^©ig*^y^F©M§i:ffig-rti 

•t„ 3©^ HI 4 (c) KaVf J:-5K*MrtjA2 7 1© 
50 #2 73 tC#LTiS!*rtI©# 274 Sr^o^gBII©^ 
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#2 7 2 

(4) ms^*m&-*m$itt&+&frz$tfim. 
u (5) ^ii*, &vt»&tt (2) 

s. 

(6) Slfi^l^-^tC^^gCDfil^^^MSr^ai 

Y©#£tt (2) ^Nffl»£fcl: (7) (C 

(7) tkomzmmmizmtSo mi 6izm&%smm io 

( 9 ) e ^raic y y vt&xmimmmm ut 

V^jWf^rtW"*, (8) 'NY&ib (10) }Cji 20 

tt. 

(10) ^LT^SE^lBjOT^il^&^^C-r 

(i i) M*&<Ds%mKv>9»vmammtfmsis 

X^&ifiZSim** (9) s\Yteb (12) K 

Jftfc. 

(1 2) *MLT^-5S^fpJ®^^^5:^^{C-r 
S. 

(13) *fcfc&<Z>W#rtJfC y 

T^S^if^H^ N&<b (1 1) 'Wfcib (14) 30 
(Ciltoo 

(14) mzLx^^wjj\(>i(Dmf8mmzttm&iz-$- 

So 

(1 5) ^(i!)N»iJ>«Ti»ll5b 
T^S^if^H^ (1 3) /\Y&ib (1 6) 

iciito 0 

(i 6) msLx\,^Nim<Dmasmi:MMuiac.-t 

(17) ZCDMM&tffa&X&ZfrZofrM^ N&«b 
(1 5) ^Y^e> (1 8) izmti. 40 

(is) diw^fcLTsaiu Aftoimzmm- 
d9) &&£&sffi$9g$#%fta (8) izm*)> & 

[0 0 3 6] ^{C, «9f?mggi&Bll 7 (a) (b) 
&ffl^T*ftt«I»CSW!-tS. if. 017 (a) tcfcn 
T. E £ <fc S *Sl®#S:«fo«te!aSRft^ 2 8 0 £ 
■tS„ &A2 8 Ofr&*T*0yiC'J >^«g2 8 4i&it 

if y -fl 2 8 0 tcStUiSW^i: LXimt 50 
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£. &&2 8 0©E#|RKZ)^e>y:/*li2 8 4S:feif 
y«*ft*a 2 8 1 £#g{rt5„ ^<DB#, ftM&a 2 8 1 
®#®#|fiir*:^ if* "Tftf * S *lft®#&j#o T V \* £ 
fcjWfc*N&©T*»9SU Iftfj&a 2 8 1 fc*ffcfc*Mfcj& 
£ LT S#I6JIC y >**&&ify«fl|y& b 2 8 2 

2 8 2H W#|ft®^&#oTV*J&VV0T»&^tti£ 

-e3T% m&itmm&ei) #e# 

|5J©#&#oT^<&©T?. 3ElCE#ft£^Ugffi,&c 
2 83&flSRU fkZWfrlfiJfc^xy*-**. ffigf&c2 
8 3 li, S 3£lfiJCD#£}$o T V *S®-eftfiij& c 2 8 3 & 
•ffc&JWfcAfc-t-*. *f*A (ii^c2 8 3) 

©S^|fiJKj*KfL/T^*«»ftd 2 8 5jb<W#|o]cZ>#£ 

»o t v \&mifi&fr y , a e> ic<gm& d 2 8 5 <dw#ipj 

K3tiSLTV*<&«tltj&e 2 8 6#N#ft(Z)^&J£oTtV 
^SGat&f 2 8 7tfte&fr¥ofr%:7-3Ly?-?Z>j!)\ 

n«*&j^2 8 0jcs*wess. xtir*0i7 (b) 

©J:-5tC. ^.2 8 0, ii^c2 8 3, «^.d2 8 
5feJ:tmii*e 2 8 6©4j£#y Lfc«/M@£2 

[0037] ewe mssmmsti o 5»conT»wrr 
s- fl6taan#i3i o 5«. j@t$ft^e>tt<z>*fltii& 

£j*u *<DW<D7mmtirtoimi>x&^fcmm<D* 
tmt tarn Lxwrnrnzmmtz $mcom& 
SHI s feM^TaBw-rs, 

[0 0 3 8] E|l 81*. m&SN&mi 0 5(D#m<DW 
<DttBBfBRikt:&ct1b<DT'* J@g2 9O0fti«!)ftS: 
*E0tf>m£2 8 9 i: L/T, #*@g©lK&S:*¥ • fitff# 
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